Non-Markovian Open Quantum Systems: Input-Output Fields, Memory, Monitoring 
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Principles of monitoring non-Markovian open quantum systems are analyzed. We use the field 
representation of the environment (Gardiner and Collet, 1985) for the separation of its memory and 
detector part, respectively. We claim the system-plus-memory compound becomes Markovian, the 
detector part is tractable by standard Markovian monitoring. Because of non-Markovianity, only 
the mixed state of the system can be predicted, the pure state of the system can be retrodicted. We 
present the corresponding non-Markovian stochastic Schrodinger equation. 

PACS numbers: 03.65.Yz, 42.50.Lc 



In a seminal paper f]\ Gardiner and Collett used quan- 
tum white-noise and the related Markovian quantum field 
to represent the dynamics of a quantum oscillator bath 
in the Markovian (memory-less) limit. This allovired the 
construction of exact stochastic differential equations to 
describe the infiuence of the bath B on the embedded 
(i.e.: open) quantum system S, the reaction of S on B, 
and the time-continuous monitoring of S. The theory be- 
came standard in quantum optics |2| and in many fields 
where a quantum system is open to natural or designed 
environmental infiuence . If the memory of B cannot 
be ignored for S then Markovian tools become jeopar- 
dized. In non-Markovian (NM) case, S is coherently in- 
teracting with a finite part of B over a finite time. From 
different theoretical efforts we distill a central ques- 

tion: how can we divide the environment B into the mem- 
ory M and detector D? Part M is continuously entangled 
with S but the compound S-l-M becomes a Markovian 
open system, as we shall argue. Part D contains infor- 
mation on S and can be continuously disentangled, i.e.: 
monitored, without changing the dynamics of S. 

As a matter of fact, the Markovian field representa- 
tion [l[ of B is capable to account for memory effects and 
leads to a natural separation between M and D. The local 
Markov field interacts with S in a finite range: this part 
makes the memory M. The output field carries away in- 
formation on S, it makes the detector D. Most features of 
the Markovian theory [1] of monitoring apply invariably 
to the composite system S-l-M. 

Earlier, Jack, Collett and Walls realized the role of a 
finite memory time in simulation [3] and in monitoring 
These authors calculated, for the first time, the retro- 
diction of the mixed quantum state. Here we exploit the 
causality features of the standard Markovian bath [H-Q 
and, among other results, calculate the retrodicted pure 
state and the current mixed state. 

Our work starts with a brief summary of the standard 
Markovian field theory [l|. Then we identify the mem- 
ory M and the detector D, and outline the scheme how 
S-l-M becomes a Markovian open system. Its Markovian 
master equation is derived followed by the derivation and 



discussion of the stochastic Schrodinger equation (SSE) 
of monitoring S. 

Markovian field, non-Markovian coupling. The com- 
posite S-f-B dynamics is based on the total Hamiltonian 



H^Hs + He 



H. 



SB, 



(1) 



where Hs is the Hamiltonian of S, the bath Hamiltonian 
is Hb — J ijohlJ)ujdijj and Hsb — j Ki^hl^dijj+h.c. is their 
interaction, where s is a S-operator that couples to the B- 
modes. Here h^^ are boson annihilation operators for the 
w-frequency modes of B, satisfying [S^^, V^,] = Siuj — uj'). 
B can be called Markovian because of the flat spectrum. 
Memory effects are fully encoded in the coupling n^. If 
the coupling is frequency- independent, Kui = const, then 
S is Markovian open system, otherwise it has a memory. 
We are interested in the latter case, i.e., in NM open sys- 
tems. We assume that S and B are initially uncorrelated. 
Let, for simplicity's, the initial B-state be the vacuum |0) 
defined by b^jjO) =0 for aU w. 

We switch for an abstract field representation [J-Q. 
The bath field h{z) is defined by 



b{z) = 



1 



'-duj, 



(2) 



where z is a real 1-dimensional spatial coordinate. For 
convenience, we set the velocity of propagation to 1. The 
canonical commutation relationship is local: 



(3) 



hence the field can be measured independently at all loca- 
tions. In particular, it can be measured in the coherent 
state overcomplete basis parametrized by the complex 
field £,{z). The (unnormalized) Bargman coherent states 



|0=exp Ui^)b\z)dz] \0) 



form an overcomplete basis: 

Mio(ri = i. 



(4) 



(5) 
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FIG. 1: The bath field b{z,t), when free, is propagating from 
right to left without dispersion at velocity 1. The unperturbed 
input field from range z > T propagates through the interac- 
tion range z G [0,T] of non-zero coupling k{z), gets modified 
by, and entangled with the system S, then it leaves to freely 
propagate away to left infinity as the output field. The in- 
teraction range makes the memory Af and the output range 
z < makes the detector D which can continuously be read 
out (monitored). 



M stands for the integral (mean) over ^ with the normal- 
ized measure according to the standard complex white- 
noise statistics, specified by 

Me(z)=0, Me(z)^(z') = 0, Maz)C{z')=S{z-z'). 

(6) 

If we perform the measurement, the state of B collapses 
on 1^) randomly, the complex field ^{z) becomes the ran- 
dom read-out. But its statistics depends on the pre- 
measurement state. In the vacuum state |0), the read- 
outs ^(z) follow the statistics ([6]). This statistics gets 
modified by the B-S interaction. Typically, the mean 
becomes non- vanishing, cf. ([T^ or (^5]) . 

Both the bath and interaction Hamiltonians can be 
written in terms of the fields: 



H: 



SB 



is / b'' {z)K{z)dz + h.c, 



(7) 



(8) 



where k{z) is the Fourier transform of k^^. 

The underlying picture [H-Q is that all B-modes are 
spatial excitations along a single direction z. The cou- 
pling k{z) is supposed to vanish outside the interaction 
range, say z £ [0, T], where T is the memory time. Mem- 
ory effects are fully confined here. (If k{z) decays only 
asymptotically to zero, finite memory time can still be a 
robust approximation 0, 0-) If ^ were a delta- function, 
k{z) cx 5(z), the interaction range would reduce to a sin- 
gle point z = 0, memory effects would be absent and S 
would be Markovian open system. 



M 



D 



FIG. 2: If we form a memory subsystem M from the local 
field oscillators of the interaction range then the system S 
and the memory M constitutes a Markovian open system. It 
is pumped by the standard Markovian quantum noise (input 
field) and it creates the Markovian output field D that can be 
monitored. 
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FIG. 3: The system-plus-memory is pumped by the stan- 
dard (external) quantum white-noise b{t + T) and monitored 
through the modified quantum white-noise foout(t) just like 
Markovian open quantum systems, apart form the delay T of 
read-out w.r.t. pump. 



Heisenberg picture 
field equation reads [l| 



b(z,t)^b(z + t)+ i s{t - t)k{z + T)dT. 



The solution of the Heisenberg 



(9) 



The first term b{z + 1) on the r.h.s. corresponds to free 
dispersionless propagation along the line, from right to 
left (cf. Fig. [Ij. The free field plays the role of the 'con- 
veyor belt' that carries information/perturbations one- 
way: from right to left, never the opposite! As usual, 
the free field will later be identified as the field ^ in 
interaction picture: 



bt{z) = b{z + t). 



(10) 



The second term on the r.h.s. of ^ represents the in- 
teraction with S, localized inside the interaction range 
z € [0,T]. In the input range z >T the vacuum field is 
freely propagating. In the output range z <0 the field is 
freely propagating and carrying away the perturbations 
emerged in the interaction range. For t > 0, the input 
field does not depend on whatever happens at z < T, and 
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the dynamics of S remains undisturbed whatever happens 
at z < to the output field. Most importantly, we can 
continuously observe the output field without altering the 
dynamics of S. Accordingly, the memory M will consist of 
the local field inside the interaction range and the detec- 
tor D will consist of the output field. We emphasize that 
the coupling of M to the rest of B is Markovian hence 
S-l-M becomes Markovian open system (Fig. [2]) . The full 
armory of Markovian continuous measurement theories 
[Il-Q, including the Ito- formalism, could be deployed — 
with some peculiarities though. 

As we said, the D part of the field is the output field 
b{z > 0,t). The earliest location of monitoring is z = 
and it is common to introduce the notation bout{t) = 
6(0, t) and it is common to call it the output field: 



bout{t) = bit) + / s{t~T)K{T)dT 



(11) 



This is the famous input-output relationship which works 
for the NM case as well. The equation expresses the vari- 
able 6out(i) which one can continuously monitor without 
affecting the dynamics of S. Since k(t) vanishes for r < 0, 
the measured signal reflects delayed and coarse-grained 
average of the S- variable s. 

In particular, if we read out bout(t) in ideal heterodyne 
measurement — which corresponds to the measurement in 
the coherent state basis (|4]) — the resulting signal 6out(0 
contains the standard complex white- noise (jG]): 



boutit) ^ ^{t) + / {s{t-T))K{T)dT 



(12) 



where {s(t)) is the quantum expectation value of the 
Heisenberg operator. 

Markovian master equation. We construct the formal 
Markovian reduced dynamics of S-l-M in Schrodinger pic- 
ture. The Hamiltonian of M and the interaction are just 
Hb and Hsb, resp., restricted for the interaction range: 



Hm — 77 



P{z)d^b{z)dz + h.: 



H 



SM 



— is {z)K{z)dz + h.i 



(13) 



(14) 



We are not ready yet. The outer input field b{z > T) , 
that we cut off, will be replaced by the time-dependent 
vacuum white-noise b{T -I- t) which is external w.r.t. M 
since we take t > {). This noise couples to b{T) of the 
upper edge 2; = T of M and pumps M via the following 
Hamiltonian: 



HMt^ib\T)b{T + t)+h.c. 



(15) 



(This choice can be confirmed in Heisenberg picture: the 
field equation db{z)/dt = i[HM + HMt,b{z)] yields the 



correct solution for z G [0,T].) As to the output 
field, we trace out the modes for z < while we must 
retain b{z = 0) = &out if monitoring is included. The 
total Hamiltonian is Hs + Hm + Hmi + Hsm- We can 
directly write down the corresponding master equation 
for the density matrix of S+M: 



PSM 

dt 



= - i\Hs 



Hm + Hsm, psm] 
1, 



(16) 



+ b{T)psMbHT) - -[bHT)b{T)psM +h.c.]. 

The non-Hamiltonian term on the r.h.s. is the typical 
second-order contribution of the white- noise Hmi- 

We have thus transformed the original NM open sys- 
tem S into a standard Markovian open system S + M 
which is pumped by the vacuum white-noise b{T + t) and 
could be monitored through &out, cf. Fig.|3l In principle, 
the Markovian master equation (1161) would be a possi- 
ble starting point to include monitoring. Unfortunately, 
the obtained equation is formal, its application would re- 
quire further specifications on Hm regarding the bound- 
ary conditions. Rather we choose an alternative tool. 

Stochastic Schrodinger equation. We are interested in 
the dynamics of the monitored quantum state. Non- 
Markovian SSEs [lll - [l3| are in tradition to describe open 
system dynamics, whereas their role in monitoring either 
was ignored |14-19,] or urged for investigations 4], then 
it led to difficulties The difficulties, related to the 

causal relationship between S and D, become transparent 
in our new treatment. 

We shall work in the interaction picture: according to 
([T0| we replace b{z) by bt{z) — b{z + t) and we replace 
s by Sf. The interaction (fT4|) becomes the functional of 
the standard vacuum white- noise b{t): 



Ht = ist b''{t + T)K{T)dT + h.c. 



(17) 



In interaction picture the separate pump Hamiltonian 
(ITSI) is not needed. To construct the Schrodinger dy- 
namics of S-l-M, let |^'5'(0)) stand for the initial state of 
S and |0) for the initial vacuum state of M. We choose 
an uncorrelated composite initial state: 

I^5m(0)) = |*5(0))|0). (18) 

Using p7|) . we get the following Schrodinger equation: 



rf|^5M(<)) 

dt 



(^St b\t + T)K{T)dT - h.c. j \^SM 



it))- 

(19) 

Observe that the r.h.s. depends on the field b{t + t) for 
r € [0,T], i.e., for later times than t itself. 

Like in case of Markovian open systems, we have to 
match the unitary evolution ()19|) with the continuous 
read-out of b{t). To this end, we project the M-part of 
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the composite state I^'s'm(O) on. the coherent state basis 



\^s[n) = r\^sM{t)). 

The Schrodinger equation (IT^ reads: 



(20) 



Jo 

''Jo ^ ^ '5e(t + r) 



(21) 



This equation is just the Schrodinger equation p9)) in dif- 
ferent representation. But it is more than that if we con- 
sider the monitoring and read-out of b{t). Then |vE's[^*]) 
is the (unnormahzed) conditional state vector of S, de- 
pending on the measured signal 5out — Since the signal 
is stochastic, we call ((2T|) the non-Markovian SSE. 

We have come to a landmark. The r.h.s. would con- 
tain the measured signal £,{t + t) at later times w.r.t. t, 
these data are not yet available at time t. We can still 
exploit the SSE in two ways. Either we propagate the 
conditional mixed state, or we propagate the retrodicted 
pure state. In both cases, we prepare the initial state 
(fTS]) of S-l-M at time t — 0, let it go and start to read 
out the signal 6out(i) = £,{t)- The field in M becomes 
entangled with S so we can never monitor the pure state 
l^/s) of S. Nonetheless, at each time t > we propa- 
gate (calculate) the solution of (|2T|) by using the latest 
read-outs ^(t) — &out(i) and by setting auxiliary values 
for ^{t + t) for T S (0, T). These latter data are not yet 
measured, we acknowledge our ignorance by tracing out 
the corresponding field degrees of freedom. Accordingly, 
we derive the following conditional mixed state from the 
pure state solution: 

(22) 

This mixed state (with a normalizing factor) is the true 
conditional state of S under monitoring. If we stick to 
the idea of a conditional pure state, we exploit the mea- 
sured signal 6out(i) differently. We use the SSE (^1]) at 
time t to retrodict the state propagation at time t — T. 
Until time t — T, measured data are not sufficient to 
retrodict any pure state. From time t ~ T on, we start 
to propagate the initial state |\E's(0)), using the signal 
^out = C measured until time t. At each time t > T, we 
have t-T]) as the solution of the SSE. And this 

(with a normalizing factor) is our retrodicted conditional 
pure state for S. The pure state |\['s[&out;^ ~ ^]) looks a 
mere mathematical construction though it will appear — 
as it were the true state — in the expression ([25]) of the 
measured output signal. 

So far we have not determined the statistics of the sig- 
nal 6out- The candidate expression (fT2l) does not resolve 
the selective evolution of S under monitoring. This selec- 
tion is only given by the SSE (l?T|) together with its inter- 
pretation (P^ . As we said before, the signal 6out would 



be the standard complex white-noise ([6]) of zero mean 
had we switched off the interaction. With the interac- 
tion on, the typical change is that the mean of 6out will 
be non-vanishing. Lessons from the Markovian special 
case and the non-selective NM form (IT^ would suggest 
the following expression: 



-rK{T)dT, 



(23) 



where (st_T)t-T is the quantum expectation value of st_r 
in the conditional mixed state ps[bout, ^out! ^ ~ ''"l or, al- 
ternatively, in the conditional pure state |^'5[6*^^; t — r]). 
We show later the second choice is the right one. 

Structured bath. Non-Markovian open systems are of- 
ten derived from Markovian coupling k„ = 1 to a NM 
bath of non-flat spectral density a^i > 0. A prototype of 
NM SSE was obtained in 1997 [lH: 

d\'fs[a*;t]) , , 4/-* /|*s[«*;i]) 

= StOfl^sia ■,t\) — sj. d(Ta[t—a)- 



dt 



5a* 



Here a^ must be a (Gaussian) complex colored noise of 
zero mean and of correlation 



Matfl* = a{t — cr). 



(25) 



where a{t) is the bath correlation function, i.e.: the 
Fourier transform of . The interpretation of this equa- 
tion drew permanent attention. Gambetta and Wise- 
man showed @, Q that no monitoring process exists for 
|\E's[a*;t]) itself. If, however, the support of a{t) is finite 
(there is a finite memory time) then the SSEs like ((24|) 
can predict the mixed conditional state at t and retrodict 
the pure conditional state at t minus the memory time 
0, Q . Now we are in a position to unfold the causality 
structure of the SSE 1997: we rewrite it into the form of 
the SSE dUl). 

The point is that the said NM bath with Markovian 
coupling can equivalently be substituted by the Marko- 
vian B with the NM coupling satisfying = a^^. Pre- 
cisely, if we solve 



a{t) 



K{t + T)K*{T)dT 



(26) 



for K{t) at condition k.{t) = for r < [20| then we can 
express at through the standard complex white- noise 



(27) 



at = / ^(i + T)K*(T)dT 



By inserting this into ([M)) . the resulting equation coin- 
cides with the NM SSE ([21]). Therefore the discussion 
and resolution of the causality issue of monitoring, cf. 
our preceeding paragraph, can be directly adapted to the 



old form of the SSE 21 



Let's verify the Girsanov transformation ^(t) ^ 6out(i) 
underlying our heuristic expression (1231) of the output 
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signal. We exploit the Girsanov transformation at => dt 
accomplished by (16) in 12|: 



at 



at+ a{t ~ T){st-r)t-TdT 



(28) 



where at,dt are related to ^(t), 6out(i)j resp., by the con- 
volution ([27|). Let's arrange all terms on one side, apply 
(P7)l and insert (1^ . yielding 



^0. 
(29) 

The removal of the outer convolution, legitimated at least 
when is nowhere zero, yields our result (P^ . From [l^] 
we know that {st-T)t-T must be taken in the retrodicted 
pure state i — r]). Since pure state retrodiction 

needs a minimum time delay T, the theoretical prediction 
([23| of the output signal &out(i) can only be calculated 
at time t + T, i.e., at current time t the latest statistical 
retrodiction concerns 6out (^ — '^) ■ This restriction is a 
typical quantum-non-Markovian feature. (However, the 
delayed access to the output signal is a common relativis- 
tic feature for any monitoring where the finite speed of 
light matters.) 

Summary. We applied the well-known Markovian 
field representation of the environmental bath at non- 
Markovian coupling to the embedded open system. We 
argued that the field in the vicinity of the system plays 
the role of memory responsible for the non-Markovianity, 
far from this vicinity it remains Markovian and subject 
to standard Markovian theory of monitoring. We un- 
folded the abstract bath into the memory and the detec- 
tor part. Our work should initiate further investigations 
along these principles. 

A formal master equation has been derived just to 
confirm Markovianity of the system-plus-memory com- 
pound. We have derived a stochastic Schrodinger equa- 
tion of the monitored system and pointed out its role in 
predicting the conditional mixed state and in retrodict- 
ing the conditional pure state — in accordance with recent 
discussions and anticipations about the fenomenological 
stochastic Schrodinger equation of Strunz and the au- 
thor. 

We are aware of two inevitable perspectives. First, 
a certain asymptotic Markovianity of the system-plus- 
memory reduced dynamics is readily seen for the Szego 
class of couplings [i^, [2^ . Investigations of asymptotic 
Markovianity should be extended for our class of cou- 
plings together with considering double-sided chain rep- 
resentations for both input and output regimes, respec- 
tively. (An independent method to treat the memory 
has appeared just recently ^^■) Second, Ito differential 
and integral calculus should be deployed to improve our 
tentative derivations. 
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